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ABSTRACT 


In  this  paper,  the  authors  consider  the  problem  of  testing  for  the 
equality  of  the  last  few  eigenvalues  of  the  covariance  matrix  under 
correlated  multivariate  regression  equations  (CMRE)  models  Asymptotic 
distributions  of  various  test  statistics  are  derived  when  the  underlying 
distribution  is  multivariate  normal.  Some  of  the  distribution  theory  is 
extended  to  the  case  when  the  underlying  distribution  is  elliptically 
symmetric. 
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1.  INTRODUCTION 

The  classical  multivariate  regression  model  plays  an  important  role  in  the 
analysis  of  the  data  in  various  disciplines.  This  model  is  nothing  but  a  set  of 
correlated  univariate  regression  equations  with  the  same  design  matrix.  But, 
situations  arise  often  when  it  is  quite  unrealistic  to  assume  the  same  design  ma¬ 
trix  for  each  regression  equation.  For  example,  it  is  not  realistic  to  assume, 
in  some  situations,  that  the  same  independent  variables  are  adequate  for  predic¬ 
tion  of  each  set  of  dependent  variables.  In  these  situations,  we  should  con¬ 
sider  correlated  multivariate  regression  equations  (CMRE)  with  different  design 
matrices.  Some  work  was  done  in  the  past  (e.g. ,  see  Zellner  (1962))  on  the 
estimation  of  location  parameters  under  correlated  univariate  regression  equations 
model.  Recently,  Kariya,  Fujikoshi  and  Krishnaiah  (1984)  considered  the  problem 
of  testing  for  the  independence  of  two  sets  of  variables  whereas  Sarkar  and 
Krishnaiah  (1984)  considered  the  problem  of  testing  for  sphericity  under  the  CMRE 
model.  In  this  paper,  we  consider  the  problem  of  testing  the  hypothesis  that  the 
last  few  eigenvalues  of  the  covariance  matrix  are  equal  under  the  CMRE  model. 

In  Section  2  of  this  paper,  we  given  some  preliminaries  which  are  needed  in 
the  sequel.  It  is  complicated  to  derive  the  likelihood  ratio  test  statistic  under 
the  CMRE  model.  So,  we  considered  a  LRT-like  test  statistic.  When  the  design 
matrices  in  the  CMRE  model  are  the  same,  the  above  test  statistic  is  equivalent 
to  the  usual  LRT  statistic  for  testing  the  hypothesis  of  the  equality  of  the  last 
few  eigenvalues  of  the  covariance  matrix.  In  Section  3,  we  derived  an  expression 
for  the  null  distribution  of  the  LRT-like  test  statistic  under  the  CMRE  model 
when  the  sample  size  tends  to  infinity.  The  expression  obtained  in  Section  3  is 
the  same  whether  the  density  matrices  are  equal  or  not.  In  Section  4,  we  derive 
the  asymptotic  distribution  of  the  LRT-like  test  statistic  under  local  alternatives. 
Asymptotic  nonnull  distributions  of  a  class  of  test  statistics  are  derived  in 


Section  5  under  fixed  alternatives.  The  above  results  are  derived  under  the 
assumption  that  the  underlying  distribution  is  multivariate  normal.  In  Sections 

6  and  7  we  extend  some  of  the  above  results  to  the  case  when  the  underlying  distib 
tion  is  elliptlcally  synanetric.  Finally,  in  Section  8»  we  discuss  applications 

of  the  results  of  this  paper  in  the  area  of  principal  component  analysis. 


2.  PRELIMINARIES 


Consider  two  correlated  multivariate  regression  equations  given  by 


where  9^:  r^xp^  ®22:  *2*^2  are  un^nown*  whereas  the  design  matrices  X^:  nxr^ 
and  X^:  n*r^  are  known  and  are  of  full  rank.  We  will  also  assume  that  the  rows 
of  (E^  E2)  are  distributed  independently  as  multivariate  normal  with  mean  vector  0 
and  covariance  matrix  £  where 


(2.2) 


and  £^  is  of  order  P^Pj*  The  model  given  by  (2.1)  is  known  as  the  correlated 

multivariate  regression  equations  (CMRE)  model.  Kariya ,  Fujikoshi  and  Krishnaiah 

(1984)  considered  the  problem  of  testing  the  hypothesis  aid  derived 

asymptotic  distributions  of  test  statistics  associated  with  testing  the  above 

hypotheses.  Sarkar  and  Krishnaiah  (1984)  derived  the  asymptotic  distributions 

2 

of  test  statistics  associated  with  testing  the  hypothesis  that  £  ■  a  I.  In  this 

paper,  we  derive  asymptotic  distributions  of  some  test  statistics  used  for  testing 

the  hypothesis  H„:  A  ..“•••“A  where  A,  >...>  A  are  the  eigenvalues  of  £. 

0  p-q+l  p  1  —  —  p 

An  estimate  of  £  is  S/n  where 


Unless  the  design  matrices  are  the  same,  S/v  is  not  an  unbiased  estimate  of  Z. 

A  a  a 

An  unbiased  estimate  of  Z  is  Z  where  Z  ■  (Z^), 

*ii-  E‘l2-r.W2/t 

A 

and  t  is  rank  of  Although  Z  is  an  unbiased  estimate  of  Z ,  it  may  not  be 

positive  definite.  So,  we  will  use  S/n  to  estimate  Z  in  the  sequel. 

We  will  now  describe  a  representation  of  S  due  to  Kariya,  Fujikoshi  and 
Krishnaiah  (1984)  since  it  is  needed  in  the  sequel.  Consider  the  transformation 


W 


i 


(2.5) 


where  is  of  order  (r^-r^xpj^  and  ^  order  (n-r^xp^.  Also,  Z^:  nx  (n-r^) 

satisfies  Z^Z^ * Iq  ^  ,  Z^Z^  ■  and  is  chosen  in  the  following  way.  Let  Qq 

-  I-X^X)-^'  where  X  ■  (X^.X^J  and  nQ*n-rQ.  Then,  we  can  express  as 

Q_  *  Z  Z'  such  that  Z'Z  «  I  .  Next,  let  Q.  (j  ■  1,2)  denote  the  projection  matrices 
u  u  u  u  u  nQ  j 

onto  L(X)  nL(Q^)  where  L(A)  denotes  the  column  space  of  the  matrix  A.  Then,  we 

can  decompose  Q.  as  Q.  »  Z.Z’  such  that  Z!Z.  -  I  .We  then  choose  Z,  *  (Z, ,Z.) 

i  1  i  i  j  j  Tq-Tj  1  1’  0 

and  Z 2  ■  (I^Zq).  In  this  case,  Z^Z^  *  and  Z^Z^  ■  1^  .  Using  this  transfor¬ 
mation,  Kariya,  Fujikoshi  and  Krishnaiah  (1984)  decomposed  S  as  follows: 


WiWl 

w;z2ziwi 


WiZiZ2W2 

W2W2 


G+B 


(2.6) 


where 
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MiMl 

M^KM, 

[M’K'M1 

m*m2 

, K  -  Z»Z2. 


(2.8) 


In  deriving  various  asymptotic  distributions,  we  use  perturbation  technique 
repeatedly.  So,  we  review  this  technique  briefly. 

Consider  a  diagonal  matrix  A  with  the  ordered  latent  roots  A^  i •  •  *  —  Ap 
and  assume  that  the  perturbation  of  A  can  be  expressed  as  a  power  series  in  z  as 
follows : 


M  -  A  +  cV(1)  +  e2V(2)  +  0(e3) , 


(2.9) 


,(J) 


where  V  J  ,  j  *1,2,...  are  symmetric  matrices  of  order  p*p  and  e  is  a  small  real 
number  and  M  is  a  pxp  symmetric  matrix  whose  eigenvalues  are  —  ^2  — ' *  *  — ^p* 
Assume  A^  is  simple  for  a*l,2,...,p.  Then  the  perturbation  expansion  of  l  is 


given  by 


aa 


(2.10) 


where 


The  above  expansion  is  due  to  Lawley  (1956). 

Next  consider  the  case  when  latent  roots  of  A  have  multiplicities.  Suppose 

A,  .  ,,*...  “A  .  ,  ■  6  ,  that  is,  9  has  multiplicity  q  for  ot  =  l,2,...,r, 

q  +q0. . .+q  .+1  q_+. ,.+q  a’  ’a  3  Ma 

nl  2  a-1  ^1  a 

q^+q2+. • *+qr * P  and  qQ  *  0.  Then  the  mean  eigenvalue  of  M  corresponding  to  9^  is 


l  -  9  +e£(1)  +eV2)  +  0(e3), 

r*  /m  rt  «•  w 


(2.11) 


where 
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3.  ASYMPTOTIC  NULL  DISTRIBUTION  OF  THE  LRT-LIKE  TEST 
The  LRT-like  test  for  Hq  is  given  by 


A 


[ 


n  t  /(f 

p-q+l  1  q 


!  yV/2, 

p-q+l  1 


where  >!>...>£  are  the  eigenvalues  of  S 
l  ~  l  —  —  p  o 

distribution  of 


We  will  consider  the 


T  -  -2  log  A 

p-q 

*  n[q  log  (trS  -  \  Z  )  -  q  log  q  -  log|  S  | 

i-1  ° 

p-q 

+  l  log*  ].  (3.1) 

i-1  1 


For  the  asymptotic  theory  we  assume,  without  loss  of  generality,  that  the  covariance 
matrix  I  is  diagonal.  Hence,  under  Hq, 


I  —  diag (X^,!^,...,!  ^ ,  X,X,»..,X) 

-Eq,  say.  (3.2) 


As  mentioned  in  the  preceding  section,  S  can  be  written  as  G  +  B  where 

G~Wp(Io,n0)  under  Hq,  and  G  and  B  are  independently  distributed.  Define 

V  -  <4r”C(G/n  )  -  E  )  «  (v. ,),  so  that 
o  o  o  ij 


S  *  —  -  E  +^L  +  J-  . 

°  *0  0  °o 

o 


We  assume  that  the  population  roots  X,,X_,...,X  are  simple. 

1  2  p-q 


li  *  Xi  +  #  +  t  {bjd  +  X  VjV  +  ^2  S 
°  ° 


(3.3) 

Then  we  have  from  (3.3) 

(3.4) 


for  j  -1,2 


(p-q)  where 


Ji  ji"jiXJkvikvjkvJ1  “ V3J  j^Jk^k 

i*J  k*j  k^j 


+  2  JjVV^k1, 

k*J 


^jk  "  “  X^)  and  X^  *  \  for  k  -  p-q+1, ... ,p. 

a-n^/n.  Then  from  (3.1)  and  (3.4)  we  get 


Next,  let  T  =  a  •  T,  where 


T  -  T  + 
o 


T  +  T 
1  2 


where 


p;q  i 
T<,  ■  I  <i r 

j-i  j 


if,  mVV  i.nl 

l  ^ikV1k  +  2  ^  ^  3 

k-1  3K  Jlt  Z  i-1  j-1 


+  l!T  .J  ’«'xi  +  i 


i-1  j -p-q+1 


?  Prq  2  n2 

'  *  i  Vi1A 

i-p-q+1  j-1  13 


2X  p-q+1  2A  p-q+1  p-q+1  3  2qA^  p-q+1 


T1  *  I  f  f  x  X  V  v 

1  j-1  xj  x  i-1  k-1  l1  ^k  ik  kJ 


n*j  kftj 


p-q  vj 


I  2  I  XikV1k  “  3  tr  (Eo 
j-1  X^  k^j  Jk  jk  3  o 


3  A  «  3  3q2X3 


p-q+1 


-7  (  ?  ?  v*k) 

qX  p-q+1  33  j-1  k-1  3*  3k 


+  ~2C  I 


p-q 

2  E  < r 

j-i  j 


■f)  2  X4,  b4l  V41 

A  k=l  3k  jk 


p-q 


-  I 


k*j 


J-l  X 


2  Vjjbjj 


“JT(  l  ?  bj:j>  +  ?  f  -tM1 

qX  p-q+1  p-q+1  J:I 


i=l  j-l  Vj 


From  (3.5),  the  characteristic  function  of  T  is 


-1. 


4>(t)  -4,(0  +  *  (t)  +  0(n  •L) 

Li  O 


where 


itT 


it 


4>1(t)  =  E[e  °{1+^T1}], 


itT  ^ 

♦  (t)-E[e  °  — Tj. 

2  v£“  2 

o 


Note  that  the  characteristic  function  of 

P 


~2(n  /n)  log  [  n  d  (i  \  d  )q  ]n/2 
p-q+1  1  qp-q+l  1 


-1, 


(3.6) 


(3.7) 


(3.8) 


is  $  (t)  +  0(n  ),  where  d1  >d  >  ...  >i  are  the  eigenvalues  of  G/n  .  We  know  that 

-L  O  1  —  Z  —  —  p  O 

[see  Fujikoshi,  1977]  ^(t)  »  (1  -  2it)”f ^2 ,  where  f  -  (q(q+l)/2)  -  1.  Without 


loss  of  generality,  suppose  q  >  p0  i.e.  p  -  q  < p, .  Then  under  H  , 

~  L  1  O 


E(bii}  "  (r0’V  V  i  =  Kl)p-q 


(rQ  -  r^)  X  ,  i * p  -  q+1, . . . ,p^ 


<r0  “  r2)  x  »  1  * Px+1» • • • *P 


E(b  )  -  0,  i  i  j. 


(3.9) 


E 


Taking  conditional  expectation  with  respect  to  s  only  we  get 


E(v  )  =0,  and  Var(v  )  =  A, 


where  A  is  a  diagonal  matrix  whose  elements  are  given  below 


Var(vii)  = 


Var  (v  ) 


r  2  A?  ,  i  =1(1)  p-q 
*-  2A^  ,  i  =  p  -  q+1, . . . ,p. 


Vj» 

AAi  ,  1  li  IP-q,  p-q+l<_j<.p 


AAj  ,  1 1  j  l"-q,  p-q+l^i^p 

a2  »  p-q+i  <  1  +  i  <P* 


The  limiting  distribution  of  V  *  (v^)  *s  t*ie  distribution  of  V  *  (v^),  where  v^ 

(i<_j)'s  are  all  independently  distributed  as  normal  with  mean  0  and  variances 

* 

given  by  (3.11).  This  implies  that,  in  the  limit,  the  elements  of  v  are  distribu' 

«•» 

ted  independently  as  normal  with  zero  means  and  variances  given  by  (3.11).  Mow, 

*,  *  • 

let  T^^v  Av  ,  where  A  is  a  matrix  whose  elements  depend  on  s,  X,  p  and  q. 

Hence , 


o 


*»  *  1  *'  -1  * 
itv  Av  --tv  $  v  r _ 
»  -  -  2  -  -  [C 


k  *  A  *  * 

1  Vl'C2  LVlld- 

Px+1  p-q+1 


=  0 


where  *  (2ir)  p  ^ 2 1 A |  1^2.  So,  from  (3.7)  and  (3.8), 


<fr(t)  -Mt)  +0(n‘1) 

1  o 

-  (l-2it)’f/2  +  0(n“1). 


(3.12 


where  f=(q(q+l)/2)  -  1. 

Inverting  the  right  side  of  (3.12)  yields  the  following  expression  for  the 
asymptotic  distribution  of  A: 

Pr  [-2nQ  log  A/n  £x]  =  Pr(Xj  £.x)  +  0(nQ^)  (3.13 


where  f  *  [ (q(q+l)/2)  -  1] 


4.  ASYMPTOTIC  NON-NULL  DISTRIBUTION  OF 
THE  LRT-LIKE  TEST  UNDER  LOCAL  ALTERNATIVES 

In  this  section,  we  derive  asymptotic  distribution  of  the  LRT-like  test  sta¬ 
tistic  under  the  local  alternative  H0  where 

HQ:  X^X^MT)  i  *p-q+l,...,p  (4.1) 


where  ^'s  are  not  all  equal.  Now,  define  V  as  V  * 
V  -  V+D0(O)  where  DQ(0)  -  diag(0, . . .  ,0,0  L . 9p) 


/T  ((G/n  )-E  )  so  that 
o  o  o 

Hence 


S 

o 


Z 

o 


(4.2) 


Ml  0 

O 

Note  that  (4.2)  is  of  the  same  form  as  of  (3.3),  except  for  the  change  that  V  is 
replaced  by  V.  Hence,  from  Section  3,  the  characteristic  function  of  T  is 


<Kt)  -♦<t)  +$,(t)  +0(n-1), 
i.  o 

where  <J>^(t),  ^^(t),  Tq,  T^,  are  as  defined  in  Section  3,  with  v^’s  replaced  by 
v^j's.  Also  note  that 


Vu  "  Vii*  i-KDp-q. 

vij  *  Vij  *  i  *  i»j  *  KDp 

v±i  *  vii  +  9i»  imp-q+i,...,p. 


Now,  define 


V 


»v 


12’ 


•Vlp,V23’ 


2p’ 


P-1.P 


), 


Then 


Pi'i'vrrr 


r-  A  ^  rn; 'y'JfX  U  W  U'JVJiVVr.i  '■>  A1  W P? A  A  r  r:  w nt ■ 

i-. 

b 

13 


I! 


* 


i 


ECV*)  -  yQ  ,  VarCV  )  -  A, 


where 


He  -  Co,...,o,  ep_q+1»*'*.ep»  o,...,o) 


and  A  was  given  in  Section  3.  As  n  -**>,  V  is  distributed  as  multivariate  normal 

o 

*•*»  -* 

with  mean  vector  y.  and  covariance  matrix  A.  Further,  we  have  T  -V  AV  and 


Vii» 


P  -  P1 

EM(T2)  mClJ  +1Vii  “  C2  *  +1 
i“P1+l  i-p-q+1 

where  C1  -  -  r2>  (q  -  p2)/Xq,  C2  -  (^  -  r2)p2/Xq  so  that  we  get 

1  oo 

<J>2(t)  -  |l-2itAA|“1/2exp[-  |  {y^  ^(2it)r(AA)r"1AVe(I] 


r-1 


x  c’l  l  (2it)r(AA)r~1Ay  ] , 
r-1  8 


(4.3) 


where  c'  -  (Qe'  -C.e'  C.e'  0e’o  ).  Note  that  the  characteristic  function 
P-q  2  q-p2  1  P2  p2^ 

of 


-2a  log  [  5  d  (J  J  d  )q]n/2 


p-q+1  *  %-q+l 


is  ij)^(t) +0(nQ  ),  where  a  -  nQ/n,  and  d^>_...  >^dp  are- the  eigenvalues  of  G/nc 
where  under  H^,  G~Wp  (nQ,  Zq  +  (D^/*1^).  Hence  (see  Fujikoshi,  1981) 

2 

*  (t)-«J>  (t,  6 2 / A.2)  [1  +  ~ l  b  x"3(l-2it)“J]  +  0(n_1) 

A  JOT  J-0  3  ° 


(4.4) 


where,  t)^(t,A)  is  the  characteristic  function  of  noncentral  x  variable  with  f  df, 
and  noncentrality  parameter  A,  and 


.••V 


«fai 


i 


a} 


m  « W 


14 

f  -  |(q  +  2)(q-l) 

2  12-1  2 

6  -  -jltrfl  -q  (trfl)  ], 

fl  "  dla8(6p_q+i . V 

b  -  7-[2tm3-3q-1(tr£2)trft2  +  q"2(trfl)3], 
o  o 

b1  -  -|[-trn3+2q“1(trfl)trn2-q”2(trQ)3], 
b2  -  i[trn3-3q“1(tr£5)tm2  +  2q”2(trfi)3]. 


Cv'.v 
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5.  ASYMPTOTIC  DISTRIBUTIONS  OF  A  GENERAL 
CLASS  OF  TEST  STATISTICS 


In  this  section,  we  derive  asymptotic  distributions  of  the  function  f (£^, . . . ,1^) 

which  is  analytic  around  (X^,...,Xp)  for  two  cases.  In  the  first  case,  we  assume 

that  the  first  partial  derivatives  of  f )  are  not  all  zero.  In  the  second 

1  P 

case,  we  assume  that  all  of  the  above  partial  derivatives  are  zero.  The  modified 
LRT  statistic,  under  the  null  hypothesis,  belongs  to  the  second  case  whereas  it 
belongs  to  the  first  case  under  the  alternative  hypothesis. 

Let  X,  ■  e.  for  i  ■  1,2, ... ,  (r-1)  and  X  ■...■X  *  X  *  0  .  Also,  let  J.  *  {i} 
for  i  -  1,2,..., (r-1)  and  Jy  denote  the  set  {r,r+l,. . . ,p}.  We  make  the  following 
assumptions : 


L  f  for  j  e  J 
3 l.  I lm\  a  J  a 

J  ■*  •» 


(5.1) 


(ii)  3£  3£,  |t«x“fa8  for  JeJa*  k  e  Jg 

J  *  m 

where  *  (£,,«..,£  )  and  X'  -  (X.,..,,X  ,,X,...,X).  Expanding  the  function 

-  1  P  -  i 

f(£, ,...,£  )  around  X'  ■  (X  ,...,X  ,X,,..,X)  and  using  perturbation  expansion 

1  P  -  i  r-i 

of  ,  we  arrive  at  the  following: 

1  P 

L-  [f(l1,...,£)-f(X1,...,Xn)] 

o  1  p  1  p 


r  ^  r  r  r 

J  f  trV  +  —  [  7  f  trB  +  T  I  f  6  ctrV  QV 

r*  rtn  r-  ■  u  n  nn  4  •  a  rv  R  nR 


a-1  a 


a  a 8  a8  8a 


1  r  r 

+  4  T  7  f  QtrV  trV  ] 
2  L  a8  aa  86 
a  a 


where  V  -  (.V^) ,  B  -  CBflg)  and  Vg  and  BQg  are  of  order  where 


Let  r  “  p-q+1.  Then, 


where 


L  -  T  +—  CT.  +  T,}  +  OCrT1} 

0  V?T  1  2  0 

0 


p;q  E 

y  f  v  +  f  Tv.., 

,  a  aa  p-q+1  ii* 

a“l  p-q+1 


P-q  P-q  2 

a  l 


p;q  p  , 

+  I/a'V  »  <  Lav 

3“1  p-q+1 


p-q  p-q  P-q  P 

+  vL 


+ 2  g*if lv»> +2  £rr<  Livii>2, 

p*1  p-q+1  p-q+1 


T2  "  iif«b aa  +  fp-q+l 


The  characteristic  function  of  L,  <j>(t),  can  be  written  as 


♦x(t)  +  ^2(t)  +  0(noA), 

where  <t) ,  <p  ( t)  have  the  same  expressions  as  in  Section  3,  with  T  ,  T, ,  T„  given 
x  *■  o  1  2 

by  (5.3). 


Now,  let 


v  is  distributed  as  multivariate  normal  with  mean  vector  0  and  co 


Then  as  n 

variance  matrix  A  where  A  is  given  in  Section  3.  Also,  let 


a*  **  (.f  1  »  •  •  •  ,  f  ,f  ,f  ,  a  a  a  jf  ,0)  a 

„o  1  p-q  r  r  r 


q 

*•  * 


Then,  T  -a'v  .  We  can  write  T.  as  T.  •  v  A  v  ,  A  being  dependent  on  f  's, 
o  _o_  1  1  ,  o.  *  o  a 


f  „’s,  A  's,  p  and  q.  Then  we  have 
aS  a 


4^(0  -e 


-t2/2*a’Aa  .  ,.,^3 

°  °[1  +  —  tr  (A  A)  +  -  -  ---  AA  A  fQ 


/n 


+  f(T^i3^xV  )H+°(n-, 


-1, 


P-q+r 


To  evaluate  q> 2 Ct ) ,  we  take  conditional  expectation  of  T ^  with  respect  to  M^'s 
and  get 


p-q 


W'V'l1  I  \,f„  +  fr  -r2)p2  +  (ro-ri)q] 

a-1 


K2  (say) 


assuming  that  q^p2  without  loss  of  generality.  Hence, 


it  ltaoV  I 

*,Ct)  "  7=  K2  E[e 
vn 

o 


.  -t  /2«a'Aa 

■  — K_  e 
2 

o 


Finally , 


.2  2 
-t  x 


*(t)  -  e_w  1  72[1  +  ~-g.  +  -^-gJ  +  0(n  ■*') 


-1» 


(5.6) 


*  -^o-21  \  f?i  +  qA‘  Wl1- 


gl-K2+tr<AoA)f 


®3  -  a;Avao+i(Tf1M+q^3fp3-q+i) 


Inverting  the  right  hand  side  of  (5.6),  we  get  the  following 


Theorem  5.1.  Let 


L  -  /a~  {f  (L,  ,...  ,  Jt .)  -  f  (X.  ,A  )}/t 
o  1  p  j.  p 

where  t>0  and  X,  >  A.  >...>  A  >A  .-••••“A  "A.  Then 
1  2  p-q  p-q+1  p 

P[L  _<  x]-$(x) — —  l(gj/x)$^  (x)  +  (g  3/t3)$^3^  (x)  ]  +  00^*) 


where  $^(x)  is  the  j**1  derivative  of  the  standard  normal  distribution  function 
<t>(x)  and  t,  g^  and  g^  are  given  hy  (5,7), 

When  q»  1  in  the  expression  (5.8),  we  obtain  the  asymptotic  distribution  of 

* 

L  when  A- >. . .»A  , 

1  P 

When  in  C5.2)  are  simultaneously  equal  to  zero,  we  cannot  obtain 

the  asymptotic  distribution  of  f (l^,. , . , f^)  from  (5.8).  For  example,  let 

fa.,...,*)-! 

1  P 

where  T  was  defined  by  (3.1).  Then 


HjU-A  v 

for  j*  1,2,..., p  when  A  -A  .  So,  the  asymptotic  distribution  of  the  LRT 

p-q-t-i  p 

like  test  statistic  cannot  be  obtained  from  Theorem  5.1. 
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Now  let 


L  «  n  (f(£ . £)-f(£ . £  )} 

O  1  p  1  p 

where  X. >X,,>. .  .>X  >X  «X  ■  X  and  we  assume  that  f (£,,...,£  )  satisfies 

1  p-q  p-q+1  p  1  p 

the  conditions  (5.1).  Also,  we  assume  that  f  =...=f  ,,*0  and  f’  are  not 

1  p-q+1  aB 


all  equal  to  zero  simultaneously.  Then 


**  i  5  5 

J  *7  I  tr  VQO 

2a-18-lae  aa  06 


(5.11) 


where.  V  -  (vu. . . .  .v  (p.1}  (r.1}  .«  V„) ,  r- p-q+1,  and  tr  and 

F  “  j(£ag).  But,  we  know  that  v^^»***»Vpp  are  distributed  asymptotically  as 

independent  normal  variables  with  zero  means  and  variances  given  by  var(v^)  * 

2  .  2  ** 

2X±  for  i“  1,2, ..  .  ,p-q  and  var(vii)  -  2X  for  i-  p-q+1, ... ,p.  So,  L  is 

asymptotically  distributed  as  a  linear  combination  of  independent  chi-square 

variables  with  one  degree  of  freedom. 


6.  ASYMPTOTIC  DISTRIBUTION  OF  AN  ANALYTIC  FUNCTION 
WHEN  THE  UNDERLYING  DISTRIBUTION  IS 
ELLIPTICALLY  SYMMETRIC 


*  ** 

Now  we  will  give  asymptotic  distributions  of  the  statistics  L  and  L 
defined  in  Section  5,  when  the  underlying  distribution  is  elliptically  symmetric. 
Here  we  note  that  x:  n*l  is  said  to  be  elliptically  symmetric  if  its  characteris 
tic  function  is  of  the  form  exp(it'ii)<Kt*flt) •  where  u:  n*l,  0:  n*n,  and  fl>0 
and  we  write  x  ~  ECQ(u,ft;$).  Multivariate  normal,  multivariate  t  and  some  other 

distributions  belong  to  the  family  of  elliptically  synmetric  distributions. 

For  a  discussion  on  the  elliptically  symmetric  distributions,  the  reader  is 

referred  to  Kelker  (1970). 

In  this  section,  we  assume  as  before,  that  the  rows  of  E  are  independently 
distributed  with  the  same  dispersion  I  and  also 


U  ~  ECn(?-Yn;*) 


(6.1 


where  X*.lr  j  -  1,2 . p. 

For  simplicity  of  notation,  let  rj-r^-  r  and  nQ-n-r.  Also  let  Qx 

Q2  *  We  889-6  that  each  of  l  qai)qaa)/no’  ^  qaa>2/no’  i 

*  a*l  a*l 

n  n 

and  l  l  /n  ,  j  -  1,2,3  are  of  0(1)  and  we  write  for  large  n 

a-1  8-1  aB  ° 


If 


-  1,2,3 


J  q(j)Vn 


aa  o 


K^j)  j- 1,2,3 


n  J-1-2-3 


01*8 


and 


J,(1V2Vn  -  Kv 

L  naa  ^oa  o  3 


(6.2 


Then  it  can  be  shown  that  the  limiting  distribution  of  Z  - 


o 


V  18 


the  same  as  that  of  Z  -  (Z^),  where 


‘±j  N(0,X1Xj^),  i*J 


where 


and 


Also 


where 


1  +  |  (♦"(o)/*,(o)2-  l)^,  i«  1,2,..., 


Ll  +|  (♦"(©)/♦•  Co)2-  1)kJ2),  1*  px+i,.  . 


r„(D  .  <j>"(o)  ,.(1).  ,  .  , 

[K0  +  2  Kx  ]  i,j  -  1 . p., 


<f>'(o) 


r„(2)  .  <t>rt(o)  _(2).  .  ,  .. 

LK.  +  -1 -  Sr  K  J*  l,j  »  p,+l,.  ♦  •  ,P 

2  <f>*  (o)2  1  1 


^ri,(3)  ♦,,(o)  ,,(3) .  ,  .  t 

[K2  +  ,  2  Ki  J*  1-1 . pi;J-pi+1 

$'(o) 


j  -  1,...  .p^  j=  px+l 


♦  "(o) 


Cov(Z..,Z..).A.X<(^?-l)C,  i*j 


ii’  11'  i  r  2 
1 2  $'(or 


k{1}  ,  i,j-l(l)Pl 


,(2) 


'2^  »  1 , J  “  Pj+l » •  •  •  »P 


»  ^™l(l)p^J  j*  Pj+l  ’  *  *  *  ■ 


All  other  elements  of  Z  are  uncorrelated. 


We  define  f (ft,,..., I  )  the  same  way  as  in  Section  5  and  make  the  same 
i  P 


assumptions  on  it.  I  also  has  the  same  structure  as  in  Section  5,  i.e. 


X  ” X  . 

p-q+1  p 


Let 


Z’  -  <Zii»-**«Zpp*Zi2»*“*Zlp*Z23 . Z2p . Z(p-l)p 


). 


Then  for  large  n. 


Z  ~  (o.fi). 


(6 


where  ft  -  (w^) 


w.  's  are  given  by  (6.2),  (6.3)  and  (6.4),  with  the  restriction  X  -X  *X 

ij  p-q+1  P 


We  get  the  following  result  for  the  asymptotic  distribution  of  f (i^, ...,£) . 


Theorem  6.1.  Let 


L  -  {f  (Z-  ,. .  .  )  -  f(X1,...,X  )}/t 

o  l  p  l  p 


where  x  >  0  and  X,>. . .>X  ■  X  , ,.«X  *X.  Then 

1  p-q  p-q+1  p 


P[L  <  x]  ■  't(x)  +  0(n  ^Z) 


(6 


where  <Kx)  is  defined  before,  and  x  -  a’fta  ,  where  (f,  ,...,f  ,f  f 

.o  _o  1  p-q  p-q+1  p-< 

* 

0,....,0).  When  q  *  1,  we  get  from  (6,6)  the  asymptotic  distribution  of  L 


when  X,>X_>. . .>X  . 

12  p 


If  f^*  OV-a  and  f^g's  are  not  all  zero  simultaneously,  we  can  write 


L  -  n  { f  ( 2.  ,...,£  )  -  f(X1,...,X  ) }  as  Z'TZ  +  0(n  ^Z),  where  T  is  a  function 
oi  p  i  p  ..  o 

** 

of  f  's,  p  and  q.  Then  the  characteristic  function  of  L  is 


1 1  -  2itrn|  +0(n  '  ), 

o 

** 

which  implies  that  for  large  n,  L  is  distributed  as  a  linear  combination  of 
2 

X  variables  with  1  d.f.  We  can  get  the  asymptotic  null  and  nonnull  distribu 


tions  of  the  LRT-like  test  as  special  case  of  the  above  results. 


7.  ASYMPTOTIC  DISTRIBUTIONS  OF  THE  LRT-LIKE  TEST 
WITH  ELLIPTICALLY  SYMMETRIC  ERRORS 

In  this  section,  we  derive  the  asymptotic  distributions  of  the  LRT-like 
test  under  the  following  assumption  on  the  errors: 

!  ~  ECnp(°*  Tn  ®  E*?4>)  (7‘1) 

* 

where  e  «  Vec  E'  and  I  is  proportional  to  Z,  Then  we  can  write  (e.g.,  see  Anderson 
and  Fang  (1982)) 

d 

E  =  RUA, 

"k  (np  j 

where  A'A  =  E  ,  A;  p*p,  U:  n*p,  Vec  U  >»  u  ^  ,  distribution  function  of  R  is 

ft 

related  to  <j>  and  R  is  independent  of  U.  Here  "X  =  Y"  means  that  the  distribution 
of  X  is  the  same  as  that  of  Y.  Let  us  write  A  *»  (A^  A^)  where  A^  is  of  order 
nxp^,  i=  1,2,  and  p=  P^+P2’  t^ien  we  have  E^  =  RUA^,  E^  =  RUA2*  Since 

'Wl  EiW2 

S  - 

E'0„Q.E,  E‘0„E„ 

2X2X1  1  2X2  2 

we  get 

s  i  R2 

A’U’Q^^  A2U‘Q2UA2 

Using  this  it  can  be  shown  that  A  is  independent  of  R“.  Hence  the  distribution 
of  A  will  be  the  same  as  in  the  normal  case.  Thus  the  asymptotic  null  and  non¬ 
null  distributions  of  A  under  assumption  (7.1)  are  the  sanfe  as  in  Sections  3  and 
4  respectively. 
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8.  APPLICATIONS 


J  The  motivaCion  behind  the  study  in  this  paper  is  to  derive  some  asymptotic 
results  useful  in  the  area  of  principal  component  analysis  under  the  CMRE  model. 
The  object  of  the  principal  component  analysis  is  to  select  a  small  number  of  im¬ 
portant  linear  combinations  of  thp  variables  which  will  best  describe  the  varia- 

/ 

tion  among  experimental  units. y  The  variance  of  i-th  most  important  principal 

component  is  given  by  X^.  If  X^  is  very  small,  then  the  corresponding  principal 

component  is  not  Important.  So,  it  is  of  importance  to  test  whether  the  magnitude 

of  X  or  the  relative  magnitude  of  X.  with  respect  to  X,+. .  .+X  is  significant, 
l  lip 

In  many  of  the  practical  situations,  the  last  principal  component  is  not  signifi¬ 
cant.  In  these  situations  we  may  test  the  hypothesis  X  • *“X  and  if  this 

hypothesis  is  accepted,  we  conclude  that  the  last  q  principal  components  are  not 
important.  One  possible  test  for  Hq  under  the  CMRE  model  is  the  modified 
LRT  test  statistic  described  in  Section  3.  Other  possible  test  statistics 

are  ratios  of  the  roots  like,  for  example,  l  . ,  (£  )  ,1  .  _  /  , 

p-q+1  p-q+1  p  p-q+1  p’ 


The  results  of  this  paper  are  useful  in  implementation  of  the  above  proce¬ 
dures. 

The  results  in  this  paper  are  also  useful  in  studying  certain  structures  of 
the  covariance  matrix.  For  example,  the  problem  of  testing  the  hypothesis  that 
E  has  the  intraclass  correlation  structure  can  be  handled  by  testing  the  hypothe¬ 
sis  that  X9«...»X  .  If  E  has  particular  structure,  we  may  take  advantage  of  the 

L  p 

structure  to  improve  the  efficiency  of  the  estimates  and  power  of  the  tests. 
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